Unmanned aerial vehicle based expansion joint failure detection system

ABSTRACT

A camera captures an image of a structural bearing, such as a hanger bearing or a rocker bearing. Additionally, an instrument detects a temperature. A computing system determines, based on the temperature, an expected angle of the bearing relative to a base line. The computing system also determines an actual angle of the bearing relative to the base line. The computing system superimposes a first line on the image, the first line indicating the expected angle. Furthermore, the computing system superimposes a second line on the image, the second line indicating the actual angle.

This application is a continuation of U.S. patent application Ser. No.15/705,594, filed Sep. 15, 2017, the entire content of which isincorporated by reference.

TECHNICAL FIELD

This disclosure relates to systems for inspection of structures.

BACKGROUND

Expansion joints are common features in bridges and other structuressubject to thermal expansion and contraction. Expansion joints may alsobe referred to as structural bearings. Example types of expansion jointsinclude pin-and-hanger assemblies, rocker bearings, and so on. Expansionjoints allow structural members to expand or contract without damagingthe structure.

SUMMARY

In general, this disclosure relates to devices, systems, and methods fordetection of expansion joint failures. As described herein, a cameracaptures images of expansion joint assemblies, such as pin-and-hangerassemblies, rocker bearing, and so on. Additionally, an instrumentdetects a temperature. A computing system determines, based on thetemperature, an expected angle of the bearing relative to a base line.The computing system also determines an actual angle of the bearingrelative to the base line. The computing system superimposes a firstline on the image. The first line indicates the expected angle.Additionally, the computing system superimposes a second line on theimage. The second line indicates the actual angle. In this way, a usermay easily compare where the actual angle of the bearing to the anglethat bearing should be at, given the temperature. The actual anglediffering significantly from expected angle may be a strong indicationthat the bearing is locked up.

In one example, this disclosure describes a method for inspecting anexpansion joint, the method comprising: receiving, by a computingsystem, an image captured by a camera, the image being of a structuralbearing, wherein the structural bearing is a hanger bearing or a rockerbearing; receiving, by the computing system, a temperature measurementgenerated by an instrument; determining, by the computing system, basedon the temperature, an expected angle of the structural bearing relativeto a base line; determining, by the computing system, an actual angle ofthe structural bearing relative to the base line; superimposing, by thecomputing system, a first line on the image, the first line indicatingthe expected angle; and superimposing, by the computing system, a secondline on the image, the second line indicating the actual angle.

In another example, this disclosure describes a computing systemcomprising: a transceiver configured to: receive an image captured by acamera, the image being of a structural bearing, wherein the structuralbearing is a hanger bearing or a rocker bearing; and receive atemperature measurement generated by an instrument; and one or moreprocessing circuits configured to: determine, based on the temperature,an expected angle of the structural bearing relative to a base line;determine an actual angle of the structural bearing relative to the baseline; superimpose a first line on the image, the first line indicatingthe expected angle; and superimpose a second line on the image, thesecond line indicating the actual angle.

In another example, this disclosure describes a non-transitorycomputer-readable storage medium having instructions stored thereonthat, when executed, configure a computing system to: receive an imagecaptured by a camera, the image being of a structural bearing, whereinthe structural bearing is a hanger bearing or a rocker bearing; receivea temperature measurement generated by an instrument; determine, basedon the temperature, an expected angle of the structural bearing relativeto a base line; determine an actual angle of the structural bearingrelative to the base line; superimpose a first line on the image, thefirst line indicating the expected angle; and superimpose a second lineon the image, the second line indicating the actual angle.

The details of one or more examples of the disclosure are set forth inthe accompanying drawings and the description below. Other features,objects, and advantages will be apparent from the description, drawings,and claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows an example Unmanned Aerial Vehicle (UAV) system, which maybe configured to implement the techniques of this disclosure.

FIG. 2 is a block diagram illustrating example components of a UAV, inaccordance with one or more techniques of this disclosure.

FIG. 3 shows an example illustration of a computing system, inaccordance with one or more techniques of this disclosure.

FIG. 4 is an example image of a pin-and-hanger assembly for an expansionjoint of a structure, in accordance with a technique of this disclosure.

FIG. 5 is an example image of a rocker bearing, in accordance with atechnique of this disclosure.

FIG. 6 is a flowchart illustrating an example operation in accordancewith a technique of this disclosure.

FIG. 7 is a flowchart illustrating an example operation in accordancewith a technique of this disclosure.

DETAILED DESCRIPTION

FIG. 1 shows an example of an Unmanned Aerial Vehicle (UAV) system 2,which may be configured to implement the techniques of this disclosure.UAV system 2 includes a UAV 6, a controller device 10, and a computingsystem 14. In UAV system 2, controller device 10 controls, for example,the flight path and data gathering functions of UAV 6, and computingsystem 14 processes the data collected by UAV 6. Although shown asseparate devices in FIG. 1, in some UAV systems, the functionality ofcontroller device 10 and computing system 14 may be performed by acommon device. Furthermore, in some UAV systems, various functionalitydescribed herein with reference to controller device 10 or computingsystem 14 may additionally or alternatively be performed by UAV 6.

Controller device 10 may, for example, be a general-purpose device suchas a personal digital assistants (PDAs), a laptop or desktop computer, atablet computer, a cellular or satellite radio telephone, a so-called“smart phones,” or any other such device. In examples where controllerdevice 10 is a general-purpose device, controller device 10 may beloaded with and may be configured to execute software designed tocontrol UAV 6. In other examples, controller device 10 may be aspecial-purpose device designed specifically for use with UAV 6.

Controller device 10 communicates with UAV 6 via communication link 18.Communication link 18 may, for example, be a direct link through a radiocommunication protocol, such as WiFi, Bluetooth, ZigBee, a proprietaryprotocol, or any other suitable protocol. In other examples,communication link 18 is a network-based link where controller device 10communicates with UAV 6 through one or more intermediary devices such asgateways, routers, switches, repeaters, or other such network devices.

Computing system 14 may, for example, include a general-purpose devicesuch as a PDA, a laptop or desktop computer, a tablet computer, a smartphone, or any other such device. Computing system 14 may be loaded withand configured to execute software designed to process data collected byUAV 6. In some examples, UAV 6 may be configured to stream data tocomputing system 14 in real-time or near real time via, for example, awireless communication link. In other examples, UAV 6 may store datawhile in flight and transfer the data to computing system 14 at a latertime, such as after the completion of a flight.

UAV 6 is shown in FIG. 1 as a quadcopter, but UAV 6 may be any type ofUAV including, but not limited to, a rotorcraft, a fixed wing aircraft,an aerostat, or any other such type of UAV. Although the techniques ofthis disclosure are not limited to any particular type of UAV, UAV 6may, for example, be a relatively small, low altitude, and low speedUAV, where in this context, small corresponds to under 100 lbs, lowaltitude corresponds to operating altitudes less than 3000 feet aboveground, and low air speed corresponds to air speeds less than 250 knots.Furthermore, it is contemplated that UAV 6 may have hoveringcapabilities, meaning UAV 6 may have the capability of remaining at anapproximately constant location in the air. UAV 6 may be configured tofly with various degrees of autonomy. In some examples, UAV 6 may beunder the constant, or near constant, control of a user of controllerdevice 10. In other examples, controller device 10 may deliver amission, including a flight plan, to UAV 6, and onboard processingcircuitry of UAV 6 may be configured to execute the mission, with littleor no additional user input.

UAV 6 may, for example, be configured to acquire any or all of audiodata, still image data, or video data. In the example of FIG. 1, acamera 16 is mounted on UAV 6. In some examples, camera 16 is mounted onUAV 6 in a turret that allows UAV 6 to change an angle of camera 16 in avertical direction and/or a horizontal direction.

In accordance with a technique of this disclosure, camera 16 of UAV 6may capture an image of a structural bearing, such as a hanger bearingor a rocker bearing. Additionally, an instrument mounted on UAV 6detects a temperature. Various types of instruments mounted on UAV 6 maydetect the temperature. For example, an infrared thermometer mounted onUAV 6 may detect a temperature of the bridge bearing or other componentsof the bridge. In another example, a thermometer may measure thetemperature of air surrounding UAV 6. In some examples, instrumentsmounted on UAV 6 may detect both the air temperature and the temperatureof bridge components.

However, structural bearings (e.g., expansion joints) are potentialpoints of structural failure. For example, if a rocker bearing is lockedup due to heavy rust, loading due to thermal expansion may betransferred to structural components that are unable to bear the load,potentially resulting in a structural failure. Accordingly, structuralbearings are frequently the subject of inspection, especially in bridgesand other structures subject to adverse environmental conditions.However, frequent inspection may be difficult and expensive.

UAV 6 may send image data, thermometer data, and other information tocomputing system 14 via a communication link 20. Communication link 20may, for example, be a direct link through a radio communicationprotocol, such as WiFi, Bluetooth, ZigBee, a proprietary protocol, orany other suitable protocol. In other examples, communication link 20may be a network-based link where controller device 10 communicates withUAV 6 through one or more intermediary devices such as gateways,routers, switches, repeaters, or other such network devices. In exampleswhere UAV 6 stores data and transfers the data to computing system 14after completion of a flight, communication link 20 may represent awired connection, such as a USB connection, Lightning connection, orother such connection. In other examples, communication link 20 mayrepresent the manual transfer of data from UAV 6 to computing system 14by, for example, ejecting a computer readable medium device from UAV 6and inserting the computer readable medium device into computing system14.

Computing system 14 determines, based on the temperature, an expectedangle of the bearing relative to a base line (e.g., a horizontal orvertical line). Computing system 14 may determine the expected anglebased on the temperature in various ways. For example, computing system14 may store historical images of the bearing along with correspondingtemperature readings. In this example, if a temperature corresponding toa current image of the bearing matches a temperature corresponding to ahistorical image, computing system 14 may determine that the expectedangle is the angle of the bearing as shown in the historical image.Furthermore, in this example, if a temperature corresponding to acurrent image of the bearing does not match a temperature correspondingto a historical image, computing system 14 may estimate the expectedangle based on multiple historical images. For example, computing system14 may store a first image of the bearing that was captured when thetemperature is 10° C., a second image of the bearing that was capturedwhen the temperature is 0° C., and so on. In this example, if thecurrent temperature is 10° C., computing system 14 may determine thatthe expected angle of the bearing is the same as the angle of thebearing shown in the first image. In this example, if the currenttemperature 5° C., computing system 14 may determine that the expectedangle of the bearing is halfway between the angles of the bearing shownin the first image and the second image, assuming linear expansion ofthe bridge members. In other example, computing system 14 may perform asimilar calculation assuming non-linear expansion of bridge members.Thus, in such examples, computing system 14 may determine the expectedangle of the structural bearing based on the current temperature, thehistorical images, and the historical temperature measurements.

In some examples, computing system 14 may determine the expected anglebased on the temperature and engineering characteristics of thestructure. For example, computing system 14 may have engineeringspecifications of the structure, such as data on lengths and materialsof applicable structural members of the structure. In this example,computing system 14 may calculate the expected lengths of structuralmembers of the structure given the temperatures of the structuralmembers and determine the expected angle of the bearing accordingly. Forinstance, the bearing may get further from vertical as the temperaturegets hotter or colder.

Additionally, computing system 14 may determine an actual angle of thebearing relative to the base line. For example, computing system 14 maydetermine that an expected angle of the bearing should by 95°, given thetemperature. In this example, computing system 14 may determine that theactual angle of the bearing relative to the same base line is 85°.Hence, in this example, the 10° difference in angle may indicate thatthe bearing is locked up.

To help a user interpret the image, computing system 14 superimposes afirst line on the image. The first line indicates the expected angle.Additionally, computing system 14 superimposes a second line on theimage. The second line indicates the actual angle. Thus, a userreviewing the image can easily see differences between thetemperature-appropriate angle and the actual angle. This may enable theuser to determine whether the bearing is seized up. In some examples,computing system 14 also superimposes the baseline onto the image.

In some examples, a tilt detection instrument in UAV 6 may detect aphysical tilt of UAV 6 at a time camera 16 captures the image. In someexamples, computing system 14 may use a tilt measurement generated bythe tilt detection instrument to determine the base line. In someexamples, computing system 14 uses readings from the tilt detectioninstrument to rotate the image to compensate for tilt of UAV 6.Furthermore, in some examples, an orientation detection instrument inUAV 6, such as a compass or gyroscope may determine a yaw and/orattitude of camera 16 at a time camera 16 captures the image. Computingsystem 14 may apply skew effects to the image to compensate for yaw andattitude variations between images.

FIG. 2 is a block diagram illustrating example components of UAV 6, inaccordance with one or more techniques of this disclosure. UAV 6includes flight equipment 50, processing circuits 52, memory 54,transceiver 56, antenna 58, navigation system 60, camera 62, sensors 64,and power supply 66. Communication channels 68 interconnect each offlight equipment 22, processing circuits 52, memory 54, transceiver 56,antenna 58, navigation system 60, camera 62, sensors 64, and powersupply 66 for inter-component communications (physically,communicatively, and/or operatively). In some examples, communicationchannels 68 may include a system bus, a network connection, aninter-process communication data structure, or any other method forcommunicating data. In some examples, power supply 66 is a battery.

Processing circuits 52 are intended to represent all processingcircuitry and all processing capabilities of UAV 6. Processing circuits52 may, for example, include one or more digital signal processors(DSPs), general purpose microprocessors, integrated circuits (ICs) or aset of ICs (e.g., a chip set), application specific integrated circuits(ASICs), field programmable logic arrays (FPGAs), or other equivalentintegrated or discrete logic circuitry. Accordingly, the term“processor,” as used herein may refer to any of the foregoingstructures, or combination thereof, or any other structure suitable forimplementation of the techniques described herein.

Memory 54 is intended to represent all of the various memory deviceswithin UAV 6. Memory 54 constitutes a computer-readable storage mediumand may take the form of either a volatile memory that does not maintainstored contents once UAV 6 is turned off or a non-volatile memory thatstores contents for longer periods of time, including periods of timewhen UAV 6 is in an unpowered state. Examples of volatile memoriesinclude random access memories (RAM), dynamic random access memories(DRAM), static random access memories (SRAM), integrated random accessmemory (IRAIVI), thyristor random access memory (TRAM), zero-capacitorrandom access memory (ZRAIVI), or any other type of suitable volatilememory. Examples of non-volatile memory include optical disk drives,magnetic disk drives, flash memory, read only memory (ROM), forms ofelectrically programmable memories (EPROM) or electrically erasable andprogrammable memories (EEPROM), or any other such type of non-volatilememory.

The processing functionality of UAV 6 may be implemented by hardware,software, firmware, or combinations thereof. Memory 54 may storesoftware and firmware that include sets of instructions. Processingcircuits 52 and, other hardware components of UAV 6, may execute theinstructions to perform certain parts of the techniques of thisdisclosure.

Processing circuits 52 may cause transceiver 56 to use antenna 58 tosend data to controller device 10 (FIG. 1) and/or computing system 14(FIG. 1). For example, processing circuits 52 may cause transceiver 56to send image data, temperature data, and other data to computing system14. Additionally, processing circuits 52 may configure transceiver 56 toreceive data, such as instructions, from controller device 10.

Camera 62 is configured to capture images. In some examples, camera 62captures images based on visible light. In some examples, camera 62captures images based on infrared radiation.

Sensors 64 are intended to represent all the various sensors included inUAV 6. UAV 6 may, for example, include one or more sensors used forflight management, such as accelerometers, gyroscopes, magnetometers,barometers, Global Navigation Satellite Systems (GNSS) sensors, tiltsensors, inertial measurement sensors, speed sensors, and others.Particularly, in the example of FIG. 2, sensors 64 include a temperaturesensor 70 and orientation sensors 72. As described elsewhere in thisdisclosure, temperature sensor 70 may detect a temperature, such as anair temperature or a temperature of a bridge component. Orientationsensors 72 may detect an orientation (e.g., attitude, yaw, tilt, etc.)of UAV 6. For instance, orientation sensors 72 may detect an angle ofUAV 6 relative to a horizontal or vertical geometric plane. Computingsystem 14 may use data from orientation sensors 72 to rotate or skewimages captured by camera 62 to regularize the resulting angle of viewof a structural bearing shown in the images.

FIG. 3 shows an example illustration of computing system 14, inaccordance with one or more techniques of this disclosure. Computingsystem 14 includes power supply 100, one or more processing circuits102, memory 104, transceiver 106, a display 108. Communication channels110 interconnect processing circuits 102, memory 104, transceiver 106,and display 108. Power supply 100 provides power to processing circuits102, memory 104, transceiver 106 and display 108. Processing circuits102, memory 104, transceiver 106, and display 108 may be implemented ina manner similar to processing circuits 52, memory 54, and transceiver56 described above with respect to FIG. 2. Display 108 may comprisevarious types of displays for outputting data, such as liquid crystaldisplays, plasma displays, light emitting diode (LED) displays, and soon.

In the example of FIG. 3, memory 104 stores an inspection unit 112 andan image archive 114. Furthermore, as shown in the example of FIG. 3,inspection unit 112 comprises an angle unit 116 and an imagemodification unit 118. Inspection unit 112, angle unit 116, and imagemodification unit 118 may comprise instructions that, when executed byprocessing circuits 102, cause computing system 14 to perform actionsascribed in this disclosure to inspection unit 112, angle unit 116, andimage modification unit 118.

In the example of FIG. 3, inspection unit 112 configures transceiver 106to receive data from UAV 6 (FIG. 1). As a result, inspection unit 112may receive various types of data from UAV 6. For example, inspectionunit 112 may receive image data, temperature data, orientation data, andother types of data from UAV 6. Thus, transceiver 106 may be configuredto receive an image captured by a camera mounted on an UAV, where theimage is of a structural bearing, such as a hanger bearing or a rockerbearing. Additionally, transceiver 106 may be configured to receive atemperature measurement generated by an instrument mounted on the UAV.

Furthermore, in the example of FIG. 3, angle unit 116 may determine,based on a temperature, an expected angle of a structural bearingrelative to a base line. For instance, angle unit 116 may determine theexpected angle of the structural bearing based on historical images ofthe structural bearing and/or structural information, as describedelsewhere in this disclosure. Additionally, angle unit 116 may determinean actual angle of the structural bearing relative to the base line. Forinstance, angle unit 116 may determine the actual angle of thestructural bearing using an artificial neural network algorithm that hasbeen trained to determine actual angles in a set of training images.

In some examples, to ease the determination of the expected angle andactual angle, angle unit 116 may rotate or skew an image such that theimage appears to be taken from the same position as historical images ofthe same structural bearing. For instance, if the historical images areall taken with a tilt of 0° relative to the horizon, but a gust of windoccurring when UAV 6 captured a new image caused the new image to betaken with a tilt of 5° relative to the horizon, angle unit 116 mayrotate the new image −5° to ensure that the new image is from an angleconsistent with the historical images. Similarly, historical images ofthe structural bearing may be taken straight on at the structuralbearing, but a camera of UAV 6 may be yawed 4° when taking a new imageof the structural bearing. Accordingly, in this example, angle unit 116may apply a skew of −4° to the new image to correct for the yaw.

Image modification unit 118 may superimpose a first line on an image ofthe structural bearing. The first line indicates the expected angle.Additionally, image modification unit 118 may superimpose a second lineon the image. The second line indicates the actual angle.

FIG. 4 is an example image 150 of a pin-and-hanger assembly for anexpansion joint of a structure, in accordance with a technique of thisdisclosure. In the example of FIG. 4, image 150 shows a first structuralmember 152 and a second structural member 154. In some instances, firststructural member 152 and second structural member 154 are beams of abridge or other structure. A first pin 156 attaches a hanger 158 tostructural member 154. A second pin 160 attaches hanger 158 tostructural member 160.

In accordance with a technique of this disclosure, computing system 14has superimposed an expected angle line 162, an actual angle line 164,and a baseline 166 on image 150. Expected angle line 162 indicates anangle that hanger 158 is expected to have given the temperature. Actualangle line 165 indicates an actual angle of hanger 158. Baseline 166 isa vertical line that a user may use for reference.

In some examples, structural member 152 is a suspended span andstructural member 154 is an anchor span. Thus, an end of structuralmember 154 closest to the pin-and-hanger assembly is supported by afixed point, such as a bridge pier. However, an end of structural member154 is not supported by a fixed point, but rather is suspended fromstructural member 154. In some examples, as part of determining theexpected angle of a structural bearing (e.g., the pin-and-hangerassembly of FIG. 4), computing system 14 may determine, based on atemperature measurement, an expected length of the suspended span. Forexample, computing system 14 may use the measured temperature to lookup, in a lookup table, the expected length of a span of material x thatis y meters at a standard temperature. Additionally, computing system 14may determine the expected angle of hanger 158 based on the expectedlength of the suspended span. For example, computing system 14 may uselookup table to determine the expected angle based on the expectedlength of the suspended span.

FIG. 5 is an example image 200 of a rocker bearing, in accordance with atechnique of this disclosure. In the example of FIG. 5, image 200 showsa first structural member 202 and a second structural member 204. In oneexample, structural member 202 is a beam of a bridge and structuralmember 204 is a plate at a top of a pier of the bridge. Structuralmember 202 may expand or contract horizontally based on temperature.Additionally, in the example of FIG. 5, a rocker member 206 has a curvedlower surface 208. Rocker member 206 is coupled to a bracket 210 at apivot point 212. A pin 214 at pivot point 212 passes throughcorresponding openings defined by rocker member 206 and bracket 210.

In normal operation, an angle of rocker member 206 changes as structuralmember 202 expands and contracts. However, the rocker bearing may lockup if rocker member 206 is no longer able to rotate at pivot point 212,e.g., due to corrosion. If the rocker bearing is locked up, the actualangle of rocker member 206 might not correspond to an expected angle ofrocker member 206. In some examples, the rocker bearing does not movecorrectly due to other conditions, such as an object being jammed into agap between structural members.

In accordance with a technique of this disclosure, computing system 14(FIG. 1) may determine, based on the temperature, an expected angle ofrocker member 206 relative to a base line 216. Additionally, computingsystem 14 may determine an actual angle of rocker member 206 relative tobase line 216. In the example of FIG. 5, computing system 14superimposes a line 218 on image 200. Line 218 indicates the expectedangle. Computing system 14 also superimposes a line 220 on image 200.Line 220 indicates the actual angle of rocker member 206. Although baseline 216 is shown in FIG. 5 as a vertical line, in other examples, baseline 216 may be a horizontal line or a diagonal line.

FIG. 6 is a flowchart illustrating an example operation in accordancewith a technique of this disclosure. The flowchart of FIG. 6 is providedas an example. In other examples, operations in accordance withtechniques of this disclosure may include more, fewer or differentactions. Moreover, the actions of FIG. 6 may be performed in differentorders or in parallel.

In the example of FIG. 6, a camera mounted on an UAV (e.g., UAV 6 ofFIG. 1 and FIG. 2) captures an image of a structural bearing (250). Thestructural bearing may be a hanger bearing, a rocker bearing, or anothertype of structural bearing for accommodating thermal expansion andcontraction. Additionally, an instrument mounted on the UAV detects atemperature (252). The instrument may detect the temperature inaccordance with any of the examples provided elsewhere in thisdisclosure. Subsequently, a computing system (e.g., computing system 14of FIG. 1 and FIG. 3) receives the image (254). The computing systemalso receives the temperature measurement (256).

The computing system determines, based on the temperature, an expectedangle of the bearing relative to a base line (258). Additionally, thecomputing system determines an actual angle of the bearing relative tothe base line (260). The computing system may determine the expectedangle and the actual angle in accordance with any of the examplesprovided elsewhere in this disclosure.

Additionally, the computing system superimposes a first line on theimage (262). The first line indicates the expected angle. The computingsystem also superimposes a second line on the image (264). The secondline indicates the actual angle. The computing system may superimposethe first line and the second line on the image by changing the valuesof pixels in the image such that the first line and the second line arevisible in the image. In some examples, the computing system may outputthe image, with the superimposed lines, for display (266). For example,the computing system may send signals representing the image to amonitor for display.

Furthermore, in the example of FIG. 6, the computing system maydetermine whether an angle between the first line and the second line isgreater than a threshold (268). For example, the threshold may be 5°,10°, or another angle value. If the angle between the first line and thesecond line is not greater than the threshold (“NO” branch of 268), thecomputing system does not take any further action. However, if the anglebetween the first line and the second line is greater than thethreshold, the structural bearing may be seized up. Accordingly, in theexample of FIG. 6, the computing system may generate, based on an anglebetween the first line and the second line being greater than thethreshold (“YES” branch of 268), an alert to indicate that thestructural bearing is potentially seized up (270). The computing systemmay generate the alert in various ways. For example, the computingsystem may output an onscreen warning containing the alert. In someexamples, the computing system sends an electronic message, such as anemail, containing the alert. In some examples, the computing systemgenerates data in a database indicating the structural bearing ispotentially seized up.

FIG. 7 is a flowchart illustrating an example operation in accordancewith a technique of this disclosure. The flowchart of FIG. 7 is providedas an example. In other examples, operations in accordance withtechniques of this disclosure may include more, fewer or differentactions. Moreover, the actions of FIG. 7 may be performed in differentorders or in parallel.

In the example of FIG. 7, a camera mounted on an UAV (e.g., UAV 6 ofFIG. 1 and FIG. 2) captures an image of a structural bearing (300). Thestructural bearing may be a hanger bearing, a rocker bearing, or anothertype of structural bearing for accommodating thermal expansion andcontraction. Additionally, an instrument mounted on the UAV detects atemperature (302). The instrument may detect the temperature inaccordance with any of the examples provided elsewhere in thisdisclosure. Subsequently, a computing system (e.g., computing system 14of FIG. 1 and FIG. 3) receives the image (304). The computing systemalso receives the temperature measurement (306).

The computing system determines, based on the temperature, an expectedangle of the bearing relative to a base line (308). Additionally, thecomputing system determines an actual angle of the bearing relative tothe base line (310). The computing system may determine the expectedangle and the actual angle in accordance with any of the examplesprovided elsewhere in this disclosure.

Furthermore, in the example of FIG. 7, the computing system maydetermine whether an angle between the first line and the second line isgreater than a threshold (312). For example, the threshold may be 5°,10°, or another angle value. If the angle between the first line and thesecond line is not greater than the threshold (“NO” branch of 312), thecomputing system does not take any further action. However, if the anglebetween the first line and the second line is greater than thethreshold, the structural bearing may be seized up. Accordingly, in theexample of FIG. 7, the computing system may generate, based on an anglebetween the first line and the second line being greater than thethreshold (“YES” branch of 312), an alert to indicate that thestructural bearing is potentially seized up (314). The computing systemmay generate the alert in various ways. For example, the computingsystem may output an onscreen warning containing the alert. In someexamples, the computing system sends an electronic message, such as anemail, containing the alert. In some examples, the computing systemgenerates data in a database indicating the structural bearing ispotentially seized up.

Although the foregoing description has been described with respect tocameras and instruments for measuring temperature mounted on UAVs, thetechniques of this disclosure may be implemented in other ways. Forexample, the camera and instrument may be mounted on a robot configuredto crawl along a structure. In another example, the camera and/orinstrument may be handheld or mounted on a support such as a tripod.

In one or more examples, the functions described may be implemented inhardware, software, firmware, or any combination thereof. If implementedin software, the functions may be stored on or transmitted over, as oneor more instructions or code, a computer-readable medium and executed bya hardware-based processing unit. Computer-readable media may includecomputer-readable storage media, which corresponds to a tangible mediumsuch as data storage media, or communication media including any mediumthat facilitates transfer of a computer program from one place toanother, e.g., according to a communication protocol. In this manner,computer-readable media generally may correspond to (1) tangiblecomputer-readable storage media which is non-transitory or (2) acommunication medium such as a signal or carrier wave. Data storagemedia may be any available media that can be accessed by one or morecomputers or one or more processors to retrieve instructions, codeand/or data structures for implementation of the techniques described inthis disclosure. A computer program product may include acomputer-readable medium.

By way of example, and not limitation, such computer-readable storagemedia can comprise RAM, ROM, EEPROM, CD-ROM or other optical diskstorage, magnetic disk storage, or other magnetic storage devices, flashmemory, or any other medium that can be used to store desired programcode in the form of instructions or data structures and that can beaccessed by a computer. Also, any connection is properly termed acomputer-readable medium. For example, if instructions are transmittedfrom a website, server, or other remote source using a coaxial cable,fiber optic cable, twisted pair, digital subscriber line (DSL), orwireless technologies such as infrared, radio, and microwave, then thecoaxial cable, fiber optic cable, twisted pair, DSL, or wirelesstechnologies such as infrared, radio, and microwave are included in thedefinition of medium. It should be understood, however, thatcomputer-readable storage media and data storage media do not includeconnections, carrier waves, signals, or other transient media, but areinstead directed to non-transient, tangible storage media. Disk anddisc, as used herein, includes compact disc (CD), laser disc, opticaldisc, digital versatile disc (DVD), floppy disk and Blu-ray disc, wheredisks usually reproduce data magnetically, while discs reproduce dataoptically with lasers. Combinations of the above should also be includedwithin the scope of computer-readable media.

Instructions may be executed by one or more processors, such as one ormore DSPs, general purpose microprocessors, ASICs, FPGAs, or otherequivalent integrated or discrete logic circuitry. Accordingly, the term“processor,” as used herein may refer to any of the foregoing structureor any other structure suitable for implementation of the techniquesdescribed herein. In addition, in some aspects, the functionalitydescribed herein may be provided within dedicated hardware and/orsoftware modules configured for encoding and decoding, or incorporatedin a combined codec. Also, the techniques could be fully implemented inone or more circuits or logic elements.

The techniques of this disclosure may be implemented in a wide varietyof devices or apparatuses, including a wireless handset, an integratedcircuit (IC) or a set of ICs (e.g., a chip set). Various components,modules, or units are described in this disclosure to emphasizefunctional aspects of devices configured to perform the disclosedtechniques, but do not necessarily require realization by differenthardware units. Rather, as described above, various units may becombined in a codec hardware unit or provided by a collection ofinteroperative hardware units, including one or more processors asdescribed above, in conjunction with suitable software and/or firmware.

Various examples have been described. These and other examples arewithin the scope of the following claims.

What is claimed is:
 1. A method for inspecting an expansion joint, themethod comprising: receiving, by a computing system, an image capturedby a camera, the image being of a structural bearing, wherein thestructural bearing is a hanger bearing or a rocker bearing; determining,by the computing system, an expected angle of the structural bearingrelative to a base line; determining, by the computing system, an actualangle of the structural bearing relative to the base line;superimposing, by the computing system, a first line on the image, thefirst line indicating the expected angle; and superimposing, by thecomputing system, a second line on the image, the second line indicatingthe actual angle.
 2. The method of claim 1, wherein: the method furthercomprises: storing, by the computing system, a plurality of historicalimages of the structural bearing; and storing, by the computing system,a plurality of historical temperature measurements, wherein theplurality of historical temperature measurements includes acorresponding temperature measurement for each historical image of theplurality of historical images, and determining the expected angle ofthe structural bearing comprises determining, by the computing system,the expected angle of the structural bearing based on a currenttemperature, the historical images, and the historical temperaturemeasurements.
 3. The method of claim 1, wherein: the structural bearingis coupled to a suspended span and an anchor span, and determining theexpected angle of the structural bearing comprises: determining, by thecomputing system, an expected length of the suspended span; anddetermining, by the computing system, the expected angle based on theexpected length of the suspended span.
 4. The method of claim 1, furthercomprising: generating, by the computing system, based on an anglebetween the first line and the second line being greater than athreshold, an alert to indicate that the structural bearing ispotentially seized up.
 5. The method of claim 1, further comprising:after superimposing the first line and the second line on the image,outputting, by the computing system, the image for display.
 6. Themethod of claim 1, wherein the camera and instrument are mounted on anUnmanned Aerial Vehicle.
 7. A computing system comprising: a transceiverconfigured to receive an image captured by a camera, the image being ofa structural bearing, wherein the structural bearing is a hanger bearingor a rocker bearing; and one or more processing circuits configured to:determine an expected angle of the structural bearing relative to a baseline; determine an actual angle of the structural bearing relative tothe base line; superimpose a first line on the image, the first lineindicating the expected angle; and superimpose a second line on theimage, the second line indicating the actual angle.
 8. The computingsystem of claim 7, wherein: the computing system comprises a memoryconfigured to: store a plurality of historical images of the structuralbearing; and store a plurality of historical temperature measurements,wherein the plurality of historical temperature measurements includes acorresponding temperature measurement for each historical image of theplurality of historical images, and the one or more processing circuitsare configured such that, as part of determining the expected angle ofthe structural bearing, the one or more processing circuits determinethe expected angle of the structural bearing based on a currenttemperature, the historical images, and the historical temperaturemeasurements.
 9. The computing system of claim 7, wherein: thestructural bearing is coupled to a suspended span and an anchor span,and the one or more processors are configured such that, as part ofdetermining the expected angle of the structural bearing, the one ormore processing circuits: determine an expected length of the suspendedspan; and determine the expected angle based on the expected length ofthe suspended span.
 10. The computing system of claim 7, wherein the oneor more processing circuits are further configured to generate, based onan angle between the first line and the second line being greater than athreshold, an alert to indicate that the structural bearing ispotentially seized up.
 11. The computing system of claim 7, wherein theone or more processors are further configured to: after superimposingthe first line and the second line on the image, output the image fordisplay.
 12. The computing system of claim 7, wherein the camera andinstrument are mounted on an Unmanned Aerial Vehicle.
 13. Anon-transitory computer-readable storage medium having instructionsstored thereon that, when executed, configure a computing system to:receive an image captured by a camera, the image being of a structuralbearing, wherein the structural bearing is a hanger bearing or a rockerbearing; determine an expected angle of the structural bearing relativeto a base line; determine an actual angle of the structural bearingrelative to the base line; superimpose a first line on the image, thefirst line indicating the expected angle; and superimpose a second lineon the image, the second line indicating the actual angle.
 14. Thecomputer-readable storage medium of claim 13, wherein: execution of theinstructions further configures the computing system to: store aplurality of historical images of the structural bearing; and store aplurality of historical temperature measurements, wherein the pluralityof historical temperature measurements includes a correspondingtemperature measurement for each historical image of the plurality ofhistorical images, and as part of configuring the computing system todetermine the expected angle of the structural bearing, execution of theinstructions configures the computing system to determine the expectedangle of the structural bearing based on a current temperature, thehistorical images, and the historical temperature measurements.
 15. Thecomputer-readable storage medium of claim 13, wherein: the structuralbearing is coupled to a suspended span and an anchor span, and executionof the instructions further configures the computing system to determinethe expected angle of the structural bearing comprises: determining, bythe computing system, an expected length of the suspended span; anddetermining, by the computing system, the expected angle based on theexpected length of the suspended span.
 16. The computer-readable storagemedium of claim 13, wherein execution of the instructions furtherconfiguring the computing system to: generate, based on an angle betweenthe first line and the second line being greater than a threshold, analert to indicate that the structural bearing is potentially seized up.17. The computer-readable storage medium of claim 13, wherein theinstructions, when executed, further configure the computing system to:after superimposing the first line and the second line on the image,output the image for display.
 18. The computer-readable storage mediumof claim 13, wherein the camera and instrument are mounted on anUnmanned Aerial Vehicle.